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1.  INTRODUCTION. 


The  simple  fractional  flow  (or  Markov- t y pe ) model  of  personnel  movements 
through  an  organization  has  been  widelv  analyzed  (see  for  example  Bartholomew 
(1973),  Blumen,  Kogan  and  McCarthy  (1935),  Lane  and  Andrew  (1955),  Rowland  and 
Sovereign  (1969)  and  has  been  widely  applied,  especially  in  military  manpower 
planning  (see  U.S.  Navy  (1973)).  Other  models  such  as  the  "cohort"  and  "chain" 
models  (see  Marshall  (1973))  and  Grinold  and  Marshall  (to  be  published))  satisfy 
more  realistic  assumptions  on  personnel  movement,  but  lack  the  convenient  struc- 
ture of  the  Markov  model.  The  purpose  of  this  paper  is  to  present  an  extension 
of  the  Markov  Model  to  one  with  a 2-dimensional  state  space.  The  state  space 
is  chosen  so  that  the  fractional  flow  m.itrix  has  a special  structure  which  is 
then  exploited. 

In  section  II  tin.  structure  ul  the  model,  is  presented  and  in  section 
III  examples  are  given.  In  section  IV  we  present  the  probabilistic  properties 
of  the  model  with  emphasis  on  computationally  tractable  formulae . In  section 
V the  structure  of  the  model,  is  exploited  in  the  personnel  stock  and  flow 
equations . 

II.  STRUCTURE  OF  THE  FRACTIONAL  FLOW  MATRIX. 

We  assume  that  for  planning  [ ur poses  an  organization  considers  time 
in  discrete  periods,  and  that  people  are  counted  at  the  end  of  each  period. 

When  counted,  a person  is  assumed  to  possess  two  characteristics  i and  j, 
and  is  said  to  be  in  state  (i.,j),  where  i represents  the  first  character- 
istic (FC),  1 s.  i s.  n,  and  j represents  the  second  characteristic  (SC), 

£(i)  s j i u(i).  Here  I(i)  and  u(i)  are  the  lower  and  upper  limits 
respectively  for  the  SC  when  i is  the  FC.  Also  let  J(i)  = i j | £ ( i ) s j s u(i)), 
the  set  of  SC's  for  FC  i,  and  let  w be  the  number  of  elements  in  J(i). 

Let  q^(j,m),  j,m  C J ( i ) be  the  fraction  of  people  in  state  (i,j) 

in  a time  period  who  move  to  state  (i,m)  in  the  next  time  period,  and  let 
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Let  Pi(j,m), 


j t J(i).  m £ J(i+1) 


be  the  fraction  of  people  in  state  (i,j)  in  a time  period  who  move  to  state 


(i+l,m)  in  the  next  time  period,  and  let  be  the  * w^_^  matrix 

tp^(j»m)]-  A basic  assumption  of  our  two-characteristic  model  is  that  move- 
ment in  one  time  period  from  states  with  FC  i can  only  be  to  states  with  FC 
i or  i+1,  or  out  of  the  system.  Following  the  notation  of  earlier  papers, 
let  Q be  the  fractional  flow  matrix  for  all  active  states  in  the  system. 
Then  Q has  the  following  structure: 


where  the  zero  matrices  have  been  suppressed.  Throughout  this  paper  we  assume 

that  people  can  leave  the  system  eventually  from  any  state  and  thus  (I-Q) 

has  an  inverse,  where  I is  the  identity  matrix.  This  inverse  (I-Q)  1 is 

called  N,  the  fundamental  matrix  (see  Kemeny  and  Snell  (I960)).  For  each  i 

let  = (I-Q^-P^)i,  where  1 is  a vector  with  every  element  equal  to  1. 

Then  A.  is  a vector  of  w.  elements,  each  one  an  attrition  fraction  fiom 
l l 

the  appropriate  state. 


• t 


III.  EXAMPLES. 

a)  The  LOS  Model. 

Let  the  "length  of  service"  that  a person  has  completed  with  an  organ- 
ization be  denoted  LOS,  and  let  the  FC  of  a person  denote  his  LOS.  If  the  LOS 
is  measured  in  the  same  time  units  as  the  planning  periods  then  each  matrix 
is  a zero  matrix.  In  each  planning  period  a person's  LOS  must  increase  by  one 
unit,  so  that  Q has  the  structure 
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By  appropriate  choice  oi  the  second  characteristic  P.  often  has  special 

structure  too.  Conside1'  a hierarchical  system  where  the  "rank"  or  "grade"  of 

an  individual  is  used  as  his  second  characteristic.  Then  the  structure  of 

each  depends  on  the  organization's  promotion  scheme.  Assume  that  in  one 

period  a person  either  stays  in  the  same  grade  or  is  promoted  one  grade.  No 

demotions  occur.  Then  P.  would  have  the  structure 

1 


x x 

x x 


r 

where  x represents  a non-zero  element, 
b)  The  (Grade,  LOS)  Mode  1 . 

If,  as  in  a)  no  demotions  occur,  and  only  single  promotions  can  occur 
in  a time  period,  then  if  1 indexes  the  grade,  and  j the  length  of  service, 
then  Q has  the  structure  shown  in  (1).  Each  submatrix  has  special  structure 
also.  Let 


I 


/, 


ft 


3 


3-3 


ij 


= probability  a person  in  state  (i,j)  at  end  of  one  period 
will  be  in  state  (i,j+l)  at  the  end  of  the  next  period, 

= probability  a person  in  state  (i,j)  at  the  end  of  one 
period  will  be  in  state  (i+l,j+i)  at  the  end  of  the  next 
period. 


The  transition  matrix  has  non-zero  elements  only  immediately 

above  the  main  diagonal : 


Qi 


0 


qi,Mi) 

0 


qi ,1 (i)+l 
0 


qi,u(i)-l 

0 


The  transition  matrix  has  non-zero  elements  only  on  a single 

diagonal  band.  If  £(i+l)  ^ £(i)  + 1 and  u(i+l)  £ u(i)  + 1,  then 
the  form  shown  below,  where: 

1)  the  top  max  {0 ,£ (i+1) - (£ ( i)+l) } rows  are  zeros, 

2)  the  last  r.o  x {0,u(i+l)-(u(i)+l) } columns  are  zeros. 

“0 

0 

Pi ,£  (i+l)-l 

Pi  ° pi,£(i+l) 

0 


has 


4 


If  Ui+1) 


i t.(i),  Che  first  l‘.(i)H-l-tL(i+l)  columns  of  P are  zeros.  If 
u(i+i)  u(i),  the  botcom  u(i)+.l-u(i-H ) rows  of  P are  zeros.  Under  any 
circumstances  has  only  one  non-zero  diagonal,  and  we  call  such  a matrix 

a diagonal  matrix.  Efficient  methods  of  storing  and  multiplying  diagonal 
matrices  are  discussed  in  Hayne  and  Marshall  (1974). 

c)  The  (Jlrado  j TIG)  Model . 

In  certain  applications  a person'-s  "time  in  graoe,"  denoted  TIG,  is 
more  important  than  hi.s  time  in  the  system  (LOS).  If  again  we  allow  no  demo- 
tions and  only  single  promotions  per  period  and  if  the  FC  indexes  the  grade 
and  the  SC  the  TIG  for  the  appropriate  grade,  then  Q has  the  same  structure 
(1)  . Each  Q.  has  Lhe  same  structure  as  in  b)  , but  now  V.(i)  = 1 for  each 
grade  i.  However,  each  matrix  has  a single  column  of  non-zeros, 

pii  ° °i 


since  promotions  to  the  next  highest  grade  lead  always  to  a TIG  of  1.  Here 
p„  is  the  fraction  those  in  grade  i,  with  time  in  grade  i equal  to  j, 
who  are  promoted  to  grade  i+1 . 

If  demotions  are  not  allowed  and  only  single  promotions  can  occur  per 
period,  then  grade  is  a characteristic  which  can  be  used  as  the  FC.  A larger 
number  of  possibilities  occur  for  the  SC.  In  addition  to  those  above  some 
useful  ones  are  (i)  skill  category,  (ii)  physical  location  in  a multi-location 
organization,  and  (iii)  educational  level.  Note  that  educational  level  could 
also  be  used  as  the  FC. 


( 
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IV.  SOME  PROBABILISTIC  PROPERTIES. 


Let  T^  be  the  set  of  states  associate  with  FC  i;  thus 

Ti  = {(i,j)  | j t J (i ) > , i = 1,2... .,n. 

Also  let  = u(i)  - S. ( i ) + 1,  the  number  of  states  in  T^  (and  J(i)). 

Finally  let  T^  be  the  single  state  "out  of  the  system." 

In  this  section  we  develop  the  probabilistic  properties  of: 

1)  any  set  of  states  T , 

2)  any  union  of  consequtively  indexed  sets  T^ , 

m 

i.e.  L/  T., 
i=k  1 

3)  the  union  of  all  transient  states,  which  we  call  T. 

One  of  the  purposes  of  this  development  is  to  show  that  the  stochastic  proper- 
ties of  Q,  typically  a large  matrix,  are  readily  calculated  in  terms  of  the 
smaller  matrices  Q.  and  P.,  and  as  seen  in  section  III  these  often  have 

l l 

extremely  simple  structure  which  leads  to  sample  computation. 

The  format  of  this  section  follows  closely  that  of  Chapter  3 of  Kemeny 
and  Snell  (1960).  The  notation  (K&S,3._._)  indicates  that  a result  follows 
from  theorem  3._._  in  Kemeny  and  Snell,  albeit  usually  not  directly, 
a)  First-Order  Properties. 

Recall  that  we  assume  system  matrix  Q has  a fundamental  matrix 
N = (I-Q)  \ and  each  element  of  N is  the  expected  number  of  visits  to 
the  column  state  starting  from  the  row  state  (K&S,3.2.4).  Since  Q has  the 
structure  shown  in  (1), 
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N = 


N NPN  NPNPN 
1 112  112  2 3 


N P N 
2 2 3 


u-1 

n (n.p.)n 

. , i i n 

i=l 

n=l 

n (n.p.)n 

. rj  i i n 

1=2 

n-1 

(N.P.)N 
i=3  i i n 


(2) 


where  N = (I-Q.)  , i = l,...,n,  the  fundamental  matrix  for  F'C  i.  Note 

that  the  large  matrix  N is  completely  determined  by  the  matrices  and 

P..  Thus  the  only  matrix  inversions  required  are  those  of  (I-Q.),  i = l,...,n. 
JL  1 

This  is  of  considerable  computational  significance  because  as  previously  men- 
tioned Q is  usually  a large  matrix. 

Each  matrix  N.  has  a probabilistic  interpretation.  We  pursue  this 
interpretation  and  show  that  these  matrices  can  be  used  to  determine  other 
probabilistic  properties  of  interest. 

In  this  section  we  make  numerous  definitions  and  denote  the  k—  one 


bv  Dk. 


Let  us  consider  first  tne  properties  associated  with  a single  set  of 


states  T.  and  define: 
i 

Dl.  v (j ,m)  = expected  number  of  visits  to  state  (i,m)  given  that  FC  i 
is  entered  in  state  (i,j), 

= a w^  x w_^  matrix  having  v^(j,m)  as  the  element  in  row 


D2.  V. 

l 


j-£(i)+l  and  column  m-f(i)+l. 


From  (2)  the  element  of  in  row  j-£(i)+l  and  column  m-£,(i)+l 

equals  the  expected  number  of  visits  to  state  (i,m)  given  that  FC  i is 
entered  in  state  (i,j).  (K&S , 3.2 .4)  . So,  from  definitions  Dl  and  D2 , we  have, 


JL 
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(3) 


V.  = N. . 

1 1 

Note  that  the  rows  and  columns  of  N.  and  V.  correspond  to  states  in 

li 

T-  in  the  same  order  as  the  rows  and  columns  of  Q.. 
i l 

Now  define: 

D3.  T^(j)  = expected  time  in  FC  i given  that  FC  i is  entered 

in  state  (i , j ) , 

D4.  = [x^(£(i) ) , . . . (u(i)) ] , a w^  x 1 vector. 

The  expected  time  spent  in  FC  i equals  the  sum  of  the  expected  number  of 
visits  to  the  various  states  in  FC  i.  From  (3)  and  D3, 


i^(j)  = component  (j-£(i)+l)  of  N^l, 


and  from  D4 , 


t . = N. 1 , a w . x 1 vector , 

ill 


(4) 


where  1 is  a vector  with  all  components  equal  to  one. 

We  next  turn  our  attention  to  where  the  process  goes  when  it  leaves 
FC  i.  The  process  upon  leaving  T^  must  enter  either  T^+^  (if  i < n)  or 
Tg.  Next  define 

D5 . b^(j,m)  = probability  of  entering  FC  i+1  in  state  (i+l,m)  given 

that  FC  i is  entered  in  state  (i,j), 


D6 . B. 

l 


D7.  b.(j) 


D8 . b. 

l 


= a w_^  x w_^+i  matrix  having  b^(j,m)  as  the  element  in 
row  j-£(i)+l  and  column  m-£(i+l)+l, 

= probability  of  ever  entering  given  that  FC  i is 

entered  in  state  (i,j), 

= [bi(£(i)) , . . . ,b  (u(i))  ] , a w.  x l vector, 
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= probabili’v  of  never  entering 


given  than  FC  i 


D9.  b.0(j) 


'i+l 


is  entered  in  state  (i,j), 


DIO.  b = [b^o(£(i)) » • • • »b^g(u(i'0  ] . a w.  * 1 vector. 

From  these  definitions  it  follows  that 


B,  =N.P,,  a w.  xw.  matrix  ( K&S ,3.5.4) , 
111  j.  1 


(5) 


and 


b.  =11.1,  a w.  x l vector, 
li  i 


b = 1 - b. 

lO  l 


N .A.  , a w.  x l vector . 
it  l 


file  matrix  B^  is  particularly  useful  in  manpower  policy  analyses. 

For  example  let  f be  a lx  vector  of  the  number  of  people  entering 

T..  Then  f.B.  is  a 1 x w.,.  vector  of  the  number  of  these  people  who  will 
l li  i-!i 

eventually  enter  Ti+1 • (K&S, 3. 3. 6).  Such  applications  will  b;  the  subject 

of  future  papers. 

Next  we  consider  the  fiist-order  properties  related  to  FC's  i and 
k where  i 6 k.  Define: 

Dll.  b ( (i, j ) , (k,m) ) = probability  of  entering  FC  k in  state  (k,m) 

given  that  FC  i is  entered  in  state  (i,j), 


DIP. . B 


ik 


= a w.  x w matrix  having  b ( (i , j) , (k ,m) ) as  the 
X K. 

element  in  row  j-£(i)  + l and  column  m-£(k)+l. 


From  definitions  D5  and  Dll  and  a simple  conditioning  argument  we  have, 

u(i) 

b ( (i , j ) , (i+2 ,m) ) = £ b ( j , r)b  (r ,m) . 

r=£(i) 

So,  from  D12, 


B,  . _ - B.B„. 

i,i+2  l i+2 
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Notice  from  Dll  that  B.  . is  an  identity  matrix  and  from  D5  that  B.  . , = B.. 

n 1,1+1  i 

More  generally  it  can  be  shown  that  for  i s k, 


B.,  - n B , a w.  * w,  matrix, 
lk  r 1 k 

r=i 

Define : 

D13.  v( (1, j ) , (k,m) ) = expected  number  of  visits  to  state  (k,m)  given 


D14 . V., 

lk 


D15.  b.k(j) 


that  FC  i is  entered  in  state  (i,j), 

= a w.  x w matrix  having  v((i, j ) , (k.m) ) as  the 
1 K. 

element  in  row  j-£(i)+l  and  column  m-2.(k)+l, 

- probability  of  ever  entering  FC  k,  given  that 
FC  i is  entered  in  state  (i,j), 


D16 . b., 

lk 


= [b±k (fi.  (i) ) , . . . ,bik(u(i)) ] , a w.  * 1 vector. 


Considering  each  row  of  B^  as  the  part  of  an  initial  probability  vector 
that  applies  to  T^,  we  then  have, 


= B^N^  a w^  x w^  matrix  (K&S.3.5.4), 


b.,  = B.,1,  a w.  x 1 vector, 

lk  lk  l 


Define : 


D17.  T^k(j)  = expected  time  in  FC  k given  that  FC  i was  entered 
in  state  (i, j) , 


D18.  t., 

lk 


[xlk(£(i)) , . . . ,Tik(u(i)) ] , a w x l vector. 


The  expected  time  in  an  FC  is  the  sum  of  the  expected  number  of  visits  to 


states  in  that  FC,  so 


t.,  - V..1,  a w.  x 1 vector, 
lk  lk  l 


J 


This  completes  our  study  of  the  first-order  properties  related  to  the. 


! 


i 


various  PC's  of  the  system.  The  foregoing  definitions  by  no  means  exhaust 
the  first-order  properties  of  the  two-characteristic  model  that  might  con- 
ceivably be  of  interest.  It  is  felt,  however,  that  these  properties  will 
often  be  of  practical  interest  and  that  other  first-order  properties  may  be 
readily  derived  from  those  given  above. 

b ) Two  Special  Cases . 

'The  elements  of  the  fundamental  matrix  for  FC  i,  N.  have  a somewhat 

1 

different  interpretation  when  the  states  in  FC  i have  what  we  call  the  "0-1 
visiting  property."  We  say  that  a state  has  the  0-1  visiting  property  if 
the  state  can  be  visited  no  more  than  one  time.  Important  examples  of  two- 
characteristic  models  in  which  all  transient  states  have  the  0-1  visiting 
property  are  the  models  in  which  the  FC  or  SC  is  length  of  service  or  where 
the  SC  is  time  in  grade. 

If  each  state  in  T has  the  0-1  visiting  property,  then  the  expected 
number  of  visits  to  a state  in  is  equal  to  the  probability  of  visiting 

the  state.  The  element  of  N in  row  j-J (i)+l  and  column  m-&(i)+l  may 
then  be  interpreted  as  the  probability  of  visiting  state  (i,irj  given  that 
FC  i is  entered  in  state  (i,j). 

Another  property  of  interest  is  the  "no  return  property."  We  say  that 
a set  of  states  has  the  no  return  property  if  it  is  impossible  to  ever  make  a 
transition  into  the  ctate  after  a transition  has  been  made  out  of  the  state. 

The  0-1  visiting  property  implies  the  no  return  property,  but  they  .’re  not 
equivalent.  For  example,  in  modelling  manpower  flows  in  the  U.S.  Civil  Service 
one  might  use  "GS  grade"  as  the  FC  and  "pay  step"  as  the  SC.  Each  state  is 
then  a couple  (grade,  pay  step).  A person  can  stay  in  the  same  pay  step  for 


1 


more  than  one  period,  so  if  there  are  no  demotions  then  each  state  would  have 


I 


i 

I 


X 


the  no  return  property  but  not  the  0-1  visiting  property. 

If  the  states  in  T have  the  no  return  property  then  it  is  possible 
to  order  the  states  in  T\  so  that  is  upper  triangular.  When  is 

upper  triangular  so  is  I-Q  and  the  computation  of  the  inverse  of  I-Q^, 
i.e.  the  fundamental  matrix  for  FC  i,  Fh,  is  considerably  easier  than  in 
the  general  case. 

If  the  states  in  1\  have  the  0-1  visiting  property,  then  not  only 
is  N.  upper  triangular  but  also  the  elements  of  on  the  main  diagonal 

are  all  ones. 

c)  Variances . 

The  format  in  this  section  follows  closely  that  of  section  a),  but  here 
we  are  concerned  with  various  second  moment  properties  of  the  two-characteristic 
model . 

Define : 

D19.  v . (j,m)  = variance  of  the  number  of  visits  to  state  (i,m)  given 

^ j 1 

that  FC  i is  entered  in  state  (i,j), 

D20.  ^2  i = a w_^  x matrix  having  v^  as  the  element 

in  row  j-Jl(i)+l  and  column  m-£(i)+l. 

Following  (K&S ,3.3.3)  , 


V2,i  ' "i<2<Bi>dg-I)  - <Vs,> 

where  for  any  square  matrix  A,  A,  and  A both  have  the  same  dimensions 

dg  sq 

as  A:  A , is  defined  when  A is  square  and  is  formed  by  setting  all  elements 

ag 

in  A not  on  the  main  diagonal  to  zero;  A is  formed  by  squaring  all  the 

° sq 

elements  in  A. 
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fi  . 


Define : 


D2.1.  \ ..  .(j)  = variance  of  the  time  spent  in  FC  i given  that  FC  i 

£ > i 


is  entered  in  state  (i,j) 


D22 . t = [j  .( 2.  ( i r „ (u(i))],  a w * 1 vector. 

4--  ^ F 4—^1  ^ I JL 


Following  (K&S,3.3.5), 


t . = (2N.-I)x . - (t.) 
2,1  l i l sq 


Define : 


D23.  v^ ( (i, j ) , (k ,m) ) = variance  of  the  number  of  visits  to  state  (k,m) 


given  that  FC  i is  entered  in  state  (i,j), 


D24 . V2(i,k) 


= a w.  * w matrix  having  v0((i  , j)  , (k,m))  as 
1 K. 


the  element  in  row  j-2(i)+l  and  column  m-£(k)+l, 


Following  (K&S,3.3.6), 


V2(i,k)  ■ V.k(2(Nk)dg-I)  - (V.k)sq. 


Define : 


D26.  »k)  = variance  of  time  spent  in  FC  k given  that  FC  i 


is  entered  in  state  (i,j). 


D27.  t2(i,k)  = [x2( (i,£(i) ) ,k) , . . . ,T2((i ,u(i)) ,k) ] , a wi  * l 


vector. 


Following  (K&S.3.3.6), 


’2(i'k)  " Bik<2\-I)Tk  - (Tlk)s,' 


If  each  state  in  T\  has  the  0-1  visiting  property,  then  the  diagonal 


elements  of  fh  are  equal  to  one,  and. 
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a 


9 


(N.)  = I, 

1 dg 

V„  . = N.  - (N.)  , 

?.,i  l l sq 


V (i  ,k)  = V.,  - (V.,  ) . 

2 lk  lk  sq 


d ) Matrices  of  t-Step  Transition  Probabilities . 

In  this  section  we  consider  the  probability  of  being  in  state  (k,m) 
t steps  after  being  in  s'ate  (i,j).  The  matrices  of  these  probabilities 
are  called  the  t-step  transition  matrices.  They  are  used  in  section  V to 
represent  the  s rock  vectors  as  a sum  of  steady-state  and  transient  components. 

Define : 

D28.  m(t : (i , j ) , (k,m) ) = probability  of  being  in  state  (k,m)  t steps 


D°d.  M.,  (t) 
xk 


after  being  in  state  (i,j),  t = 0,1,2,... 

= a w.  * w matrix  having  m(t ; (i , j ) , (k ,m) ) as  the 
1 K. 

element  n row  j-£(i)+l  and  column  m-£(k)+l. 


The  rows  of  M.,  (t)  are  associated  with  states  in  T. ; the  columns  of  M (t) 
lk  i lk 

are  associated  with  states  in  T.  . 

k 

We  have  immediately  that 

M..(0)  = I. 

From  our  assumptions  on  the  structure  of  Q we  have, 

M (t)  = 0 if  i>k, 

1 K. 

=0  if  t < k-i. 

If  the  process  is  to  be  in  state  (k,m)  exactly  t steps  after  being 
in  state  (i,j),  then  it  must  be  in  some  state  with  FC  k or  k-1  exactly 
t-1  steps  after  being  in  state  (i,j).  Conditioning  on  this  fact  leads  to  the 


recursive  equation, 
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Mik(t)  - Mik(t-1)<!i  + Mi,k-i(r-1>pi-r  1 * l-2' 


(7) 


For  any  i and  k the  sum  over  t of  the  probability  matrices  h (t) 
gives  the  matrix  of  the  expected  number  of  visits  to  states  with  FC  k start- 
ing from  states  with  FC  i.  So  we  have. 


l M (t)  = V i * k, 

t=0  k K 


= 0, 


ocherwise . 


Recall  that  the  Q.  matrices  are  transient,  so  V.,  is  matrix  of 
i lk 

finite  elements.  This  implies  that. 


(8) 


lim  M. , ( t ) = 0. 
lk 

t-XX> 


From  (/)  it  can  be  shown  by  an  inductive  argument  that 


t-1 


(9) 


vc>’  i Mi.k-1<t-i  r)pk-X- 

r=0 


(10) 


The  t-step  transition  matrices  provide  a rather  compre  lensive  picture 
of  how  people  move  through  a two-characteristic  system. 

e ) Conditioning  on  Promotion  When  the  FC  is  Grade. 

In  manpower  planning  one  is  often  interested  in  conditional  probabilities, 
e.g.  the  probability  of  attaining  grade  k given  that  grade  i is  attained. 

The  stochastic  properties  of  the  transient  matrix  Q under  conditioning  on 
promotion  when  the  FC  is  grade  are  briefly  developed  in  this  section. 

Define : 

D30.  (i,j;t)  = the  event  "in  state  (i,j)  at  time  t" 

D31.  T.  = the  event  "a  transition  is  made  into  T,  before  leaving 

k k 

the  system." 


Conditioning  on  the  event  T is  the  sa:ne  as  conditioning  on  promotion  to 

K. 

grade  k. 

Define : 


D32 . qi(.i,m)  = Pv[  (i  ,m;  t+1)  | (i  , j ; t)  ] 

D33 . q^j.m)  = Pr  [ (i  ,m;  t+1)  | (i  J , c;  ,T*+1  ] 


Provided  that  Pr  [T^J  (i , j ; t ) ] ^ 0,  we  have  by  conditional  arguments, 

* bt(m) 

q.(j,m)  = q.(i,m)  x . 

1 


(ID 


Define : 

D34 . C.  = a w.  x w.  matrix  having  the  elements  of  b,  (see  D8)  on  its 
ill  i 

main  diagonal  and  zeros  elsewhere. 

We  assume  that  promotion  to  grade  i+1  is  possible  from  even  state 
in  T\ . Under  this  assumption  exists.  If  promotion  to  grade  i+1  is 

impossible  from  sore  state  (i,j)  then  we  must  avoid  conditioning  on  an 
impossible  event.  This  is  readily  accomplished  Iv  temporarily  treating  state 
,j)  as  part  of  Tq  (out  of  the  system)  and  redefining  J(i),  Q^,  P^  and 

accordingly. 

Define : 

* * 

D35.  = a w^  x matrix  having  q^(j,m)  as  the  element  in  row 

j-£(i)+l  and  column  m-k(J_}+l. 

Then  from  (11)  and  D34 , 

* -1 

Q.  = C.  Q.C. . 

l ill 

* 

The  matrix  is  the  matrix  of  within  grade  one-step  transition  probabili- 

ties conditioned  on  the  attainment  of  grade  i+1. 
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Define : 


D36 . 
D37. 
D38. 


Pi ( j >m) 
* 

P.(j  .">) 


= Pr [ (i+1 ,m; t+1 ) | (i ,j ;t) J 
= Prf (i+1 , a;t+l) | (i,j ;t) ,T*+iJ 


= a w . x w . , 


matrix  having  p . (j ,m)  as  the  element 


i i -1  ~ ‘ 1 

in  row  j-£(j.l+l  and  column  ;n-P.  (i+l)+l . 


We  then  have, 


Thus  from  D34  and  D38, 


P*(1  »m)  - PjO.m)  * ■ 


* -1 

P . = C . P . . 

l l l 


Tne  matrix  P^  is  the  matrix  of  one-step  promotion  probabilities  conditioned 

on.  the  attainment  of  grade  i+1  . 

Beca  ise  (Q-)r  = C.^^C., 
i l l l 

the  fundamental  matrix  for  grade  i when  we  condition  on  promotion  to  grade 
i+1  is 

* * -1 
N.  = (I-Q.) 

DO 

n J* 

- I <V 

r-0 

00 

= T cT1orc. 

n ill 
r=0 

= cT1  N.c. . 

1 li 

Define : 

k 

D39.  v^(j,m)  = expected  number  of  visits  to  st  ...e  (i,m)  given  that 

grade  i is  entered  ir  state  (i,j)  and  grade  i+1  is 
at  tained . 
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JL 


fe’-icnna 


D40 . V. 

1 


D41.  b^(j ,m) 


D4  ^ . B . 

1 


a w.  x w.  matrix  having  v.(j,m)  as  the  element  in 

IX  j. 

row  j-£(i)+l  and  column  m-ifi'l+l 
probabil  .cy  of  entering  grade  (i+1)  in  state 
given  that  grade  i is  entered  in  state  (i,j)  and 
grade  i+1  is  attained. 

k 

a w_^  x v;  ^ matrix  having  b (j,m)  as  the  element 
in  row  j-£(i)+l  and  column  m-£(i+l)-l. 


k 

l .4, 


I 

4. 


Then  one  may  show  that, 


* * 

V.  = N., 

L 1 


* * * 

B.  = N.P. 

1 11 

= cTV . 

1 1 

k k 

Note  that  B^  is  simply  B^  with  its  rows  normalized,  but  is  not 

simply  a row  normalized  form  of  Q^. 

* 

As  with  the  matrices  B^,  products  of  matrices  B^  with  successive 

indices  are  well  defined:  their  meaning  is  that  of  a matrix  B^  as  defined 

in  Dll  and  D12  with  conditioning  on  attainment  of  grade  k. 

The  conditioned  and  unconditioned  matrices  may  be  used  together.  For 

k 

example,  the  elements  of  B^B^+^  give  the  probabilities  of  entering  grade 
i+2  in  the  column  state  conditioned  on  starting  from  the  row  state  in  T. 


and  eventually  attaining  grade  i+2. 


V.  EQUATIONS  OF  STOCKS  AND  FLOWS. 


We  begin  by  defining  the  terms  "stocks"  and  "flows,"  and  then  discuss 


why  stocks  and  flows  are  important  in  manpower  planning  models  Next  the 
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relations  between  stocks  and  flows  in  a two-cha racteristic  model  are  developed. 


► 


i 


L 


Finally,  we  show  how  the  stocks  can  be  represented  as  the  sum  of  a "steady- 
state"  component  and  a "transient"  component. 

a ) Def i nitions  and  Background . 

A period  is  the  interval  of  time  from  immediately  after  an  integer 
value  of  the  time  parameter  t up  to  and  including  Lhe  next  integer  value  of 
t.  A period  is  identified  by  the  value  of  the  time  parameter  at  the  end  of 
the  period.  Thus, 

period  t^  = { t : t^-1  < t ^ t } 

where  t is  an  integer. 

The  number  of  people  in  a state  at  the  end  of  a period  is  referred  to 
as  the  "stock"  in  that  state.  Thus,  stocks  are  counted  only  at  integer  values 
of  the  time  parameter  t. 

The  number  of  people  who  change  their  status  in  the  system  from  one 
state  to  another  during  any  period  is  referred  to  as  a "flow."  Flows  occur 
during  a period,  but  we  do  not  specify  the  exact  time  at  which  they  occur. 

Stocks  and  flows  are  of  primary  importance  in  most  manpower  planning 
models.  The  most  obvious  reason  for  this  is  that  costs  are  closely  related 
to  stocks  and  flows,  e.g.  total  payroll  depends  on  stocks,  transportation 
costs  or  retraining  costs  depend  on  flows.  Recruiting  policy  and  promotion 
policy  depend  in  the  short  term  on  present  stocks  and  in  the  long  term  on  how 
we  model  future  stocks  and  flows.  Determining  the  feasibility  of  a retirement 
plan  and  evaluating  the  effects  of  a change  in  billet  structure  are  other 
instances  in  which  the  planner  needs  to  be  able  to  model  stocks  and  flows  in 
a manpower  system. 
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We  now  define  the  variables  that  are  used  to  model  the  stocks  and 


r 

[ 


flows  in  the  two-characteristic  model.  Recall  that  T.  is  the  set  of  states 

1 

associated  with  FC  i,  w.  is  the  number  of  states  in  T. , and  for  conven- 

1 i 

ience  of  notation  we  assume  the  second  characteristic  takes  on  successive 
integer  values  for  FC  i. 

In  a Markov  model  the  stocks  and  flows  are  in  general  random  variables. 
In  this  section  we  deal  only  with  the  expected  values  of  stocks  and  flows. 

Such  a model  is  called  a "fractional  flow  model”  because  the  transition  proba- 
bilities of  the  Markov  model  are  in  effect  treated  as  fractions  which  direct 
flows  through  the  system  in  a deterministic  manner. 

Let , 


s . . (t) 
ij 


expected  stocks  in  state  (i,j)  at  ti.ne  t, 


si(t)  ' (siJ(i)(t) sl,«(i)(t))l 

a 1 x w^  vector  of  expected  stocks  in  T\  , 


s(t) 


(s  (t),...,s  (t)), 
i n 


a lx  V w.  vector  of  expected  stocks  in  the 
i=l  1 

system. 


By  our  basic  assumption,  flows  into  any  state  in  T\  must  come  from  a 

state  in  either  T.  or  T.  , . We  also  make  provision  in  our  model  for 
l l-l 

"external  flows."  The  source  of  such  flows  i.s  unspecified.  However,  we  may 
consider  external  flows  as  consisting  of  people  hired  into  the  system.  The 
external  flows  may  be  deterministic  or  random,  but  we  deal  only  with  their 
expected  values. 

Let , 
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cl  (t)  = expected  flow  from  states  i n T.  to  state  (i,j) 

ij  1 

during  period  t,  a scalar: 

d . ( t ) - (d.  .(t),...,d  ,..(t)),  a 1 x w vector; 

L l.M-U  l>U(,l)  1 

f (t)  = expected  external  flow  into  state  (i,j)  during 
VI 

period  t,  a scalar; 

£i(t>  ■ (fi,«.(i)(t) fi,u<i)(r))-  a 1 * "i  vector; 

g..(t)  = expected  flow  from  states  in  T\  ^ to  state  (i,j) 

during  period  t,  a scalar; 

Bilt)  ■ («i,t(i)(t) *i,u(i)(0)>  a 1 * “i  vect°r- 

When  i = 1,  g (t)  is  defined  to  be  zero. 

The  relation  between  the  flow  vectors  and  the  stock  vector  in  grade  i 
is  depicted  in  Figure  1 where  "Tvt"  denotes  the  states  with  FC  i at  time 


w*-1 


fju) 


b ) Basic  Stock  Equation. 


Clearly,  from  our  assumptions, 

si  (t ) = d±  ( t ) + f ± (t ) + g± ( t ) . 

(See  Figure  1. ) 

It  will  be  convenient  to  define. 


s^ft)  =0,  a vector  of  zeros, 
Pp  = 0,  a matrix  of  zeros. 

Using  conditional  expectation  we  then  have 


di ( t ) = si(t-l)Qi,  i = 1 , • . . , n , 

g± (t)  = si_1(t_1)pi_1>  1 = • • • >n> 

The  basic  stock  equation  is  then, 


si(t)  = si(t-l)Qi  + fj,(t)  + si_1  ^t~1)pi_.1>  1 = 1 n>  (12) 

The  basic  stock  equation  for  FC  i can  be  written  in  terms  of  the 
expected  or  actual  stocks  with  FC  i in  previous  periods.  By  recursively 
applying  the  basic  stock  equation  for  s (t) ,s  (t-1) , . . . ,s^  (1)  one  obtains 


t-1  t-1 

s.(t)  = s.(0)Q^  + l f.(t~r)Qj  + l s._1(t-r-l)P._1Q^, 
r=0  r=0 


t = 0,1,2,...,  (13) 

i — 1 , . . . , n , 


which  we  will  refer  to  as  the  cumulative  stock  equation. 

Equations  (12)  and  (13)  are  used  frequently  in  the  remainder  of  this 
paper.  Some  manpower  models  used  in  the  U.S.  military  for  short-range  fore- 
casting consist  principally  of  an  application  of  an  equation  similar  to  (12) . 
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c ) Transi t nt  Properties  of  the  Stock s 


In  this  section  we  develop  a method  for  expressing  the  stock  vector 
as  a sum  of  a "steady-state"  component  and  a "transient"  component.  This 
method  helps  one  to  understand  hew  the  stock  vectors  change  in  going  from 
any  present  stock  vector  to  future  stock  vectors.  This  method  also  helps 
one  interpret  the  character  of  the  limiting  stock  vector. 

We  do  not  want  to  restrict  ourselves  to  cases  in  which  the  stock  vector 
converges  (as  t increases)  to  a finite  vector.  We  say  that  the  vector 
function  s^(t)  is  a steady-state  component  of  the  stock  vector  s,(t)  if, 

lim  (s . (t )-s . ( t) ) = 0 . 

£-K»  ^ ^ 

For  any  sequence  of  stock  vectors  <s  (t)>  there  is  more  than  one  choice  of 
the  steady-state  component.  In  applications  one  would  prefer  a steady  state 
component  having  a relatively  simple  mathematical  form.  We  show  that  in  some 
cases  a judicious  choice  of  s^O)  makes  this  possible.  The  following  theorem 
shows  the  properties  of  a class  of  steady-state  components  which  are  quite 
useful . 

Theorem.  For  any  collection  of  1 x w^  vectors  s (0)  , i = l,...,n, 

/v 

let  the  vector  functions  s^(t)  satisfy 

si(t)  = ~i(t-l)Qi  + f i ( t ) + si_1(t-l)Pi_1 , t = 1,2,..., 

i — 1 > • • • »n  , 

i.e.  the  vector  functions  s^(t)  satisfy  the  basic  stock  equation  (12).  Then 
(a)  the  actual  stocks  u:  time  t ate 

i 

si(t)  = s.(t)  + l (sk(0)-sk(0))Mki(t) , 
k=l 


.3 


. * 


(b) 


l (s,(t)-r.(t))  = i (Sjoj-s;.'o))BkiNi, 


t=0 


k=l 


£ 1 x w^  vector  having  finite  components, 

(c)  s^(t)  is  a steady-state  component  of  the  stock  vector  s^Ct),  i.e. 

lim  (s . ( t)-s . (t) ) - 0 . 
t-x» 

Before  proving  the  theorem  we  explain  why  one  might  be  interested  in 
such  a theorem.  Part  (c)  of  the  theorem  says  that  s^(t)  is  a steady-state 
component  of  the  stock  vector  s^(t),  and  part  (a)  shows  how  the  stock 
vector  s^(t)  can  be  expressed  as  the  sum  of  a steady-state  component  and  a 
transient  component.  Part  (b)  of  the  theorem  says  that  the  total  over  all 
periods  of  the  difference  between  the  stock  vector  and  its  steady-state  com- 
ponent is  a readily  calculated  finite  vector. 

Such  information  can  be  useful  when  long-range  planning  has  been  done 
using  an  "equilibrium  model."  As  an  example  consider  an  organization  which 
intends  to  change  from  its  present  size  of  250,000  to  a size  of  200,000.  The 
manpower  planner  may  use  an  equilibrium  model  to  develop  policies  that  are  in 
some  sense  optimal,  and  these  policies  will  maintain  the  size  of  the  organiza- 
tion at  200,000  people  once  the  organization  has  been  reduced  to 
this  size.  So  the  equilibrium  model  tells  the  planner  what  to  do  once 
the  size  of  the  organization  reaches  the  desired  equilibrium  level  but  it 
doesn't  tell  him  how  to  change  the  organization  from  its  present 
level  (250,000)  to  the  desired  equilibrium  level  (200,000).  This  problem  of 
finding  an  optimal  transition  policy  to  go  from  present  stock  levels  to  a future 
equilibrium  stock  distribution  is  a very  difficult  one  (see  Chapter  4 , Bartho- 
lomew (1973)).  One  method  for  making  the  transition  is  to  immediately  implement 
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the  hiring,  promotion  and  attrition  policies  that  have  been  derived  from  the 
equilibrium  model  . Because  of  the  transient  nature  of  the  system  these  policies 
will  eventually  bring  the  stocks  in  the  system  to  their  equilibrium  levels. 

In  the  theorem  the  vsctor  functions  s^(t)  play  the  role  of  what  the 
stocks  would  be  at  time  t if  the  system  were  in  equilibrium.  The  stock 
vectors  s^(t)  indicate  what  the  stocks  will  be  at  time  t if  we  start  with 
the  present  stocks  s^(0)  and  implement  the  policies  of  the  equilibrium  model 
(which  are  reflected  in  the  external  flows,  f^(t),  and  the  transition  matrices 
Q^,  and  ) . From  part  (a)  of  the  theorem  we  may  readily  calculate  the 

difference  between  actual  stocks  and  equilibrium  stocks  in  any  grade  and  any 
period.  If  there  is  a penalty  associated  with  having  more  people  than  the 
equilibrium  stocks  in  the  system,  then  part  (b)  of  the  theorem  may  be  used  to 
calculate  the  total  penalty.  Part  (c)  of  the  theorem  assures  the  planner  the t 
the  difference  between  the  actual  and  equilibrium  stocks  does  converge  to  a 
zero  vector  as  the  time  parameter  t increases. 

The  proof  of  the  theorem  follows. 

Proof.  By  hypothesis  the  vector  functions  s^(t)  satisfy  the  basic  stock 
equation  (12),  so  they  must  also  satisfy  the  cumulative  stock  equation  (13): 

Z.M  - sl(0)Q{  + l ft(t-r)Q[  + f Sj.jiM-DFj.X- 


r=0 


r=0 


Of  course  the  stock  vectors  s^(t)  also  satisfy  the  cumulative  stock  equation 
(13) , so  we  have , 


t-1 


si(t)  - s^t)  = (s^(O)-sT.  (0)  )Q*?  + l (si_1(t-r-l)-si_1(t-r-l))P11Q^. 

r=0 


When  i = 1 this  implies, 
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Si(t)  = s^t)  + (s1(0)-s1(0))qJ 
1 

= ^(t)  + l (sk(0)-sk(0))Mk  (t), 

k=l  ’ 

so  we  have  shown  that  part  (a)  of  the  theorem  is  true  when  i = 1.  Suppose 
part  (a)  of  the  theorem  is  true  for  grade  i-1,  i.e. 

si-i(t>  ‘ Vi(t>  + X <\<o)-\<o))\,i-i(t>- 

k=l 


Then, 


i-1 


1_1(t-r-l)-s..1(t-r-l)  - I (»k(0)-sk(0))M^  (t-r-1), 

k=l 


and 


.(t)  - 7lM  - (s1(0)-71(0»Qj  + I I (sk<0)-rk(0))Mk  l_1(t-r-l)P._1Q' 

IT  U K — _L 


t-i  i-i 


= (s 


t(0)-t.(0))q5  + J (sk<0)4k(0))  Y 
k— i r— 0 


From  equation  (10)  in  Section  IV 


t-1 


so  we  have  shown  by  induction  that, 

i-1 

s.(t)  - s.(t)  = (s.(0)-s.(0))Qj  + l (sk(0)-sk(0))Mk.(t). 


This  proves  part  (a)  of  the  theorem. 
From  part  (a) , 


°°  l 


l (s.(t)-s  (t))  = l l (s  (0)-s  (0))li  (t) 

t=0  t=0  k=l  K K K1 

i oo 

= l (s  (0)-s  (0))  l K (t) 

k=i  k k t=o  kl 
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= I 0 

k=l 


k<0)-sk(0))Bk.Ni, 


a 1 x w.,  vector  having  finite  components. 
The  last  step  above  follows  from  equations  (6)  and  (8)  of  Section  TV.  This 
proves  part  (b)  of  the  theorem. 

Part  (c)  follows  from  the  fact  that  the  sum  in  part  (b)  is  finite,  and 
the  proof  of  the  theorem  is  complete. 

The  utility  of  this  approach  depends  on  our  ability  to  find  vectors 
s^(u)  such  chat  the  vector  functions  s^(t)  are  simple  and  readily  calculated. 
Some  examples  follow. 

1 . Fixed  External  Flows. 

The  equilibrium  models  previously  mentioned  enjoy  some  popularity  in 
military  manpower  planning  in  the  United  States  (see  for  example,  RAND  Corpora- 
tion (1973)).  The  rationale  underlying  the  use  of  such  models  is  that  one 
should  determine  the  organization  structure  and  the  policies  to  maintain  this 
structure  which  are  optimal  (or  "leas'-  infeasible").  Among  the  policies 
derived  from  an  equilibrium  model  is  the  hiring  policy.  This  has  the  form, 


f.(t)  - fi,  t = 1,2,..., 
i ■ 1 , . . . ,n 


where  the  vector  of  the  number  of  people  to  be  hired  into  the  states  in  grade  i 
each  period,  f^,  is  specified  from  the  equilibrium  model. 

Define, 


fw 


(0)  = f^. 


Then  using  (12)  it  is  easy  to  show  that 

s^(t)  = f^N^  for  all  t. 
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Thus,  from  the  theorem 


S-^t)  = s^t)  + (s1(0)-s1(0))M11(t) 


= f1N1  + (s1(0)-f1N1)Qj. 


Now  recursively  define. 


3i  ' si<c)  ’ frV 


s.  = (f.+s.  ?.  )N.,  i = 2,...,n. 

1 1 l-l  l-l  l 


(14) 


It  is  straightforward  to  verify  that  these  s satisfy  the  basic  stock 
equation  (12),  so  we  have  from  the  theorem,  when  f^(t)  = f ^ , 


si(t)  ‘ 3i  + J,  <sk<0)'3k)Mki(t>- 
k=l 


The  steady-state  component  can  also  be  written, 

ri  ‘ j,  fAiNi'  ‘ «» 

k=l 

i 

Note  that  £ f B is  a non-negative  1 * w.  vector,  so  the  limiting 
, 1 K.  K.1  1 

k=l 

vector  of  stocks  in  grade  i must  be  a non-negative  combination  of  the  rows 
of  N^ . Thus,  in  general,  not  all  non-negative  1 * w^  vectors  are  possible 
limiting  stock  vectors  under  constant  external  flows. 

2 . Linear  Growth  of  External  Flows. 

In  this  section  we  consider  the  case  in  which  the  number  of  people  hired 

into  each  state  increases  by  the  same  amount  each  period.  Such  a hiring  policy 

may  not  be  natural  over  a long  period  of  time,  but  it  may  provide  a simple 

approximation  to  planned  hiring  policies. 

Let  the  1 x w.  vector  f.  be  the  increase  in  the  number  hired  into 
l l 

states  with  FC  i each  period.  Then  the  external  flow  vector  for  FC  i is, 
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Let , 


fj_(t)  = tf.L,  t « 1,2, ...  , 

i = 1 n. 


s1(0'  - "f <_N1Q1N1  ■ 


Let  the  vector  function  s^(t)  satisfy  the  basic  stock  equation  (1), 

Si(t)  = s^('t-l)Q1  + f L ( t)  . 

Using  the  identity  N^Q^+I  = N^  one  can  show  that 


sx  (t)  = tf1N1  - N^N^ 


Thus  from  the  theorem, 


sx(t)  = tf1N1  - f1N1Q]_N1  + (s1(0)+f1N1Q]N1)Q1. 


We  note  that  s (t)  is  of  the  form 


s1(t)  = + C1 


where  L^  = f^N^  is  a 1 x w,  vector, 


and  C,  = -f,N,Q,N,  is  a 1 x w.  vector. 
1 1 11  1 l 


Consider  some  FC  it  {2,...,n}.  Suppose  that 
7i-l(t)  * CLi-l  + Ci-1* 


where  L.  , and  C,  , are  1 x w.  , vectors, 
l-l  i-1  i-1 


Using  the  identity 


(tf  .N. -f.N.Q.N.  )Q.  + (t+l)f.  = ( ( t+1  ) f . N . f . N Q . N ) , 
ill  ixi  l i i li  l i l i 

one  may  show  that  if 


s.(t)  = tf.N.  - f.N.Q.N,  + s.  .(t-l)P.  ,N,  - L.  ,P.  .N.Q.N., 
i i i i ii  i l-l  l-l  l l-l  l-l  li  i 
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then  s^(t)  satisfies  the  basic  stock  equation  (12).  Note  that  s^(t)  has 
the  form, 

s . (t)  = tL.  + C . , 

1 1 l 

where , 


and , 


L. 

l 


f.N.  + L.  _P.  ,N. 
l l l-l  l-l  l 


= (fi+Li-lPi-l)Ni’ 


(16) 


C.  = -(f.+L.  P ) N . Q . N . - (L.  ,-C.  .)P.  N . 

l l l-l  l-l  ii  l i-1  l-l  l-l  i 


" -«Li-rci-i)pi-i + WVV 

Thus  we  have  shown  that  when  the  external  flows  grow  linearly  the  steady-state 
component  of  the  stocks  also  grows  linearly. 

By  recursive  substitution  in  (16)  we  have, 


b ‘ J,  fAiV 

k=l 


Note  that  this  vector  gives  the  expected  number  of  visits  to  states  with  FC 
i of  f^  = f^(t+l)  - f^(t)  entrants  with  FC  k,  k = l,...,i.  That  is,  the 
growth  in  the  stocks  with  FC  i each  period,  L^,  equals  the  expected  number 
of  visits  to  FC  i of  the  growth  in  the  external  flows  each  period  in  the 
FC's  less  than  or  equal  to  i. 

Both  L.  and  C.  have  the  fundamental  matrix  N.  as  a right  factor, 
ii  l 

so  the  steady  state  component  of  the  stock  vector,  s_^(t)  must  be  a non- 
negative combination  of  the  rows  of  N^.  This  same  result  was  observed  in 
the  case  of  constant  external  flows. 

In  summary  we  have  shown  that  by  choosing 


s.(t)  = tL.  + C. 

l ii 


30 


where 


= f when  i = 1 , 


= (f.+L  ,P  1 )N  , i = 2, . . . ,n, 
l l-x  l-I  t 


= — f^N^Q-j  Nj  when  i = 1, 

- -«L1~rci-i>pi-i+fiWNi'  1 ' 2 "• 

then  from  the  theorem  the  stock  equation  may  be  written 

i 

S.(c)  = s (t)  + l (s  (0)-s  (0))M,  (t). 

K“  i 

3 . Geometric  G rowth  o_f_  lixt e r n al_  Flows . 

In  this  subsection  we  show  that  geometric  growth  of  external  flows  1 ;ads 
(eventually)  to  geometric  growth  of  the  stocks.  We  consider  the  case  in  which 
the  external  flows  into  the  states  in  grade  i are  proportional  to  a known 
vector  f and  grow  geometrically  at  a rate  0..  . Thus, 

f.(t)  = eh.,  t = 1,2,...  , 

i = 1, . . . ,n 

9.  > 0. 

l 

When  0 < 0^  < 1,  the  external  flows  contract  rather  than  grow. 

If  0 is  not  an  eigenvalue  of  Q.  for  k £■  i ^ n we  may  define, 

K X 

vv  ■ (i  -fv1- 

k 

If  the  states  in  grade  i have  the  0-1  visiting  property  then  all  eigenvalues 
of  are  zero  and  thus  0^  > 0 is  never  equal  to  an  eigenvalue  of  in 

this  case. 


The  following  identity  will  be  useful: 
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Define , 


no 

W - L‘eLVr 


r=0  k 


VVqi  * °k  i <e!  <!L,r+1 

r=0  k 


Uk<":+Ni<t’k,) 


s*l  (0 ) - f !N,  (0 1 ) . 

Then  it  can  be  shown  that  if 

SjU)  = O^fjNj  (01)  , 

then  s^(t),  t = 0,1,...,  satisfies  the  basic  stock  equation,  and  from  the 
theorem, 

s1(t)  = °if1N1  (°  x)  + (s1(O)-f1N1(01))Mu(t). 

Note  that  the  steady-state  component  of  the  FC  1 stock  vector  grows  geometri- 
cally at  the  same  rate  as  the  external  flows  into  FC  1. 

Define , 

i-1 

B.  .(0.  ) = n (N  (0.  )P  ),  1 * k £ i & n. 

k l k , m k m 

rii 

Then  it  can  be  shown  that  if 


(t)  = l 

k=l 


t-(i-k) 


WVVV 


then  s^(t),  t = 0,1,...,  satisfies  the  basic  stock  equation  (12).  Note  that 
in  the  limit  the  stocks  with  TC  i grow  geometrically  at  the  rate  of  the 
largest  0^  where  k £ i. 
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Define, 


7* 


0M  = max{6^;  k=l , . . . , i } , 

The  steady-state  component  of  the  stock  vector  is  not  in  general  a non-negative 
combination  of  the  rows  of  Ik  (as  was  the  case  with  constant  external  flows 
and  linear  growth  of  external  flows).  Rather  the  steady-state  stock  distribu- 
tion is  a non-negative  combination  of  the  rows  of  N.(0„).  The  rows  of  N.(0  ) 
need  not  be  non-negative  combinations  of  the  rows  of  Ik  , so  the  limiting 
stock  distributions  that  are  possible  under  geometric  growth  of  external  flows 
need  not  be  the  same  as  the  limiting  stock  distributions  under  constant  external 


flows  and  linear  growth  of  external  flows. 
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